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Preface 

On March 24, 2014, the Institute for Behavior and Health, Inc. (IBH) hosted a one-day symposium in 
Washington, DC of thought leaders with expertise in addiction treatment, research, health care, public 
policy, and government to discuss current outcome measures of treatment for substance use disorders 
and to recommend ways these measures could be improved. These individuals comprise the IBH 
Addiction Treatment Outcomes Working Group. 


The symposium established a framework with a long-range perspective for the evaluation of addiction 
treatment. This framework recognized that addiction was a commonly chronic relapsing disorder and 
that follow-up monitoring and support after treatment was almost always absent, making relapse the 
expected outcome of addiction treatment. The new outcome evaluation framework aimed to make 
recovery the expected outcome of addiction treatment. Assessment of the success of addiction 
treatment would not be measured only, or even primarily, by what happens during treatment, as is 
common today, but rather by what would happen after treatment: “Then what?” would be the 
fundamental new question for treatment evaluation. 
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Introduction 

The United States has had a century of experience with independent clinicians and programs that deliver 
services to treat persons suffering from substance use disorders. For the most part these addiction 
treatment programs and clinicians operate in a specialized segment of medical care that lack standards 
of effectiveness and measures of long-term outcomes. Though substance use disorders are chronic 
illnesses, unlike the routine treatment for other chronic conditions such as diabetes or heart disease, 
there is no long-term or lifelong model of addiction treatment and few replicable standard measures of 
long-term treatment outcomes. 


Presently, the typical measure of the effectiveness of substance use disorder treatment is reduction in 
the quantity or frequency of substance use during the course of a treatment intervention or, in rare 
instances, up to 12 months post-intervention. Such a short follow-up interval fails to reveal whether 
there are long-term benefits derived from a particular episode of treatment. A shift to long-term 
outcome measures of sustained recovery as opposed to short-term periods of reducing the use of one 
or more drugs has the potential to change the way in which treatment is evaluated. The data from such 
a long-term outcome evaluation has the potential to guide changes in treatment to improve long-term 
outcomes. 


This report from the Institute for Behavior and Health, Inc. proposes a standard measure of five-year 
recovery for the treatment of substance use disorders. This long process of change begins by redefining 
the initial primary goal of addiction treatment as being both long-term abstinence from the use of 
alcohol and other drugs and improved quality of life. It also begins with identifying practical strategies 
for how long-term patient outcomes can be assessed. How can addiction treatment programs and 
clinicians that provide episodes of treatment for substance use disorders, insurance companies that 
cover the costs of this care, and others including employers and the criminal justice system assess long- 
term outcomes? Using sustained five-year abstinence and recovery as the primary measure of 
treatment outcomes can reshape both research and clinical practice. It can increase the quality of 
treatment, spawn a new generation of monitoring and care management and deliver more consistently 
the outcome widely sought but seldom achieved: a sustained addiction- and substance-free, healthy 
lifestyle. 


The adoption of five-year abstinence and recovery as a treatment outcome measure would not replace 
other measures of effectiveness, including in-treatment assessments, but it would add to those 
measures. It would ensure that the standard measure of treatment effectiveness is long-term recovery 
and it would encourage addiction treatment programs and clinicians to make recovery the expected 
outcome of treatment. This report suggests a way forward to a standard of five years for assessing the 
outcomes of addiction treatment. It encourages providers and payers in addiction treatment to develop 
a variety of ways to assess five-year outcomes with the goal of improving treatment outcomes. 


The report briefly reviews the definition of “recovery”, reviews the evidence that supports the 
proposition that long-term recovery can be the expected outcome of substance use disorder treatment, 
and discusses alternate methods that could be used to collect five-year abstinence and recovery 


outcome data. An Appendix reviews the current measures of effectiveness and evidence-based 
treatment for substance use disorders. 


Making Recovery the Expected Goal of Addiction Treatment 

Sustained recovery and an improved quality of life should be the expected goal of treatment for 
substance use disorders. A broadly representative group of experts convened by the Betty Ford 
Institute in 2007 defined recovery as “a voluntarily maintained lifestyle characterized by sobriety, 
personal health, and citizenship.” The American Society of Addiction Medicine (ASAM) defined 
recovery as “a process of sustained action that addresses the biological, psychological, social, and 
spiritual disturbances inherent in addiction. This effort is in the direction of a consistent pursuit of 
abstinence, addressing impairment in behavioral control, dealing with cravings, recognizing problems in 
one’s behaviors and interpersonal relationships, and dealing more effectively with emotional responses. 
Recovery actions lead to reversal of negative, self-defeating internal processes and behaviors, allowing 
healing of relationships with self and others. The concepts of humility, acceptance, and surrender are 
useful in this process.”” The Substance Abuse and Mental Health Services Administration (SAMHSA) 
defines recovery from mental disorders and substance use disorders as, “a process of change through 
which individuals improve their health and wellness, live a self-directed life, and strive to reach their full 
potential.”* 


Recovery implies long-term abstinence from the use of alcohol and other drugs. This report considers 
abstinence to be an immediate goal of treatment both during episodes of treatment and following 
discharge from treatment. The use of prescribed medicines, including buprenorphine, methadone and 
naltrexone, as intended by prescribing physicians is fully compatible with abstinence, but the 
nonmedical use of other drugs, including alcohol, is not. The gold standard for this model of abstinence 
used by programs featured in this report is also the standard of the 12-step fellowships of Alcoholics 
Anonymous and Narcotic Anonymous. Abstinence is not necessarily a primary objective of all addiction 
treatment programs. Some set a treatment goal, of cutting down on alcohol or other drug use or so 
called “responsible” or “safe” use of alcohol or other drugs. While there is evidence that a significant 
reduction in alcohol drinking is beneficial to health, total abstinence is the preferred and most stable 
outcome goal for treatment programs. 


: Betty Ford Institute Consensus Panel. (2007). What is recovery? A working definition from the Betty Ford 
Institute. Journal of Substance Abuse Treatment, 33(3), 221-228. 

? American Society of Addiction Medicine. (1982, February 1). State of Recovery. Public Policy Statement on the 
State of Recovery. Available: http://www.asam.org/advocacy/find-a-policy-statement/view-policy- 
statement/public-policy-statements/2011/12/16/state-of-recovery 

> Substance Abuse and Mental Health Services Administration. (2011, December 22). SAMHSA announces a 
working definition of “recovery” from mental disorders and substance use disorders. SAMHSA News Release. 


Rockville, MD: SAMHSA. Available: http://www.samhsa.gov/newsroom/advisories/1112223420.aspx 








Recovery also includes healthy living, wellness, and productive engagement.” Common measures of 
addiction treatment assess outcomes only during treatment and measure only the reduction in the use 
of a specific drug. This discrepancy is especially egregious because all episodes of addiction treatment 
are brief, while substance use disorders are life long, with a continuing threat of relapse. There is a 
popular perception that treatment ‘fixes’ those with substance use disorders. This perception fails to 
recognize the lifelong nature of the disorder. It has important public health policy implications because 
it limits the way that outcomes of treatment and other interventions are defined and measured, and 
encourages acceptance of limited outcomes. 


Perspective: Measuring Abstinence to Show Long-Term Recovery 










Because abstinence is a realistic objective in addiction treatment and is a primary foundation for 
establishing recovery, this report places emphasis on measuring abstinence. The programs featured 
in this report measure abstinence with results from frequent, random drug and alcohol testing. Such 
results demonstrate that five-year abstinence is being achieved by individuals with substance use 
disorders. 


As noted, in this report there is much more to recovery than abstinence. Only after an extended 
period of abstinence, improved state of personal health and engaged citizenship, can an individual be 
considered to be in recovery. 


The New Paradigm for Recovery 

New systems of active, long-term care management — which may include episodes of relapse followed 
by return to addiction treatment — demonstrate that long-term abstinence and recovery can be the 
expected outcome of addiction treatment. Long-term abstinence is best exemplified by the system of 
care management used for the past four decades to treat addicted physicians, commercial pilots and 
lawyers. This model of long-term, active care management for substance use disorders, termed the 
New Paradigm, is comparable to the way treatments for other chronic conditions today are managed in 
medicine.” 


Physician health programs. Physician health program (PHP) care management requires abstinence 
conditions (for alcohol and all non-prescribed drugs), intensive and sustained monitoring and deterrence 
through swift, certain, and meaningful consequences for non-compliance. The length of the PHP model 
of care management separates this model from other treatment interventions. Participating physicians 


“ Institute for Behavior and Health, Inc. (2014).The New Paradigm for Recovery: Making Recovery — and Not 
Relapse — the Expected Outcome of Addiction Treatment. A Report of the John P. McGovern Symposium, 
November 18, 2013, Washington, DC. 
5 . 

Ibid. 


are required to sign a five-year monitoring contract.° The PHP program typically begins with a formal 
episode of treatment, either residential or intensive outpatient day treatment, lasting between 30 to 90 
days (with an average of 72 days). Following successful completion, participants are subject to intensive 
random substance testing throughout the duration of the program, although the frequency of testing 
tapers over time and as a result of sustained compliance. With random testing at any frequency, testing 
can occur on any day, even the day immediately following a test. This random testing is crucial to the 
effectiveness of the PHP care management and the New Paradigm. The long-term outcomes of the PHPs 
are consistent across primary substances of abuse (e.g. alcohol and intravenous use of opiates), and 
among physicians from different specialties (e.g. surgeons and anesthesiologists). 


The long-term recovery rates for physicians in PHPs are between 70-96 percent which is the highest in 
all of the treatment outcome literature.’ A longitudinal cohort study of 904 physicians admitted to 16 
PHPs used outcome measures of program completion, continued abstinence of alcohol and other drug 
use, and continued occupation after five years.® Of the original sample, there were known outcomes for 
802 physicians. Only 155 (19.3 percent) failed to complete their contract of treatment and supervision; 
over half of these individuals voluntarily stopping their medical licenses, another 30 percent had their 
medical licenses revoked, and others died either during monitoring or before five-year follow-up. Of the 
647 (80.7 percent) physicians that completed treatment and resumed practice under supervision and 
monitoring, alcohol or drug use was detected by urine testing in only 126 (19 percent) over the five-year 
period with only 33 (26 percent) of these participants who had a test positive for alcohol or drug use 
having repeat positive test results. Approximately 81 percent of participants never failed a test for 
alcohol or any other drug during their five-year participation in the PHP. At the five-year follow-up, 78.7 
percent of the participants were licensed to practice and still working. The remainder of participants 
were retired (3.5 percent), died (3.7 percent), or had an unknown status (3.2 percent). Only 10.8 
percent had their licenses revoked. 


The concern has been raised that the PHP results are atypical because they apply to a specific 
population that is well-educated and highly motivated to comply with program requirements and 
remain abstinent.’ *° Physicians in PHPs are faced with the loss of their medical license (i.e., their 


° DuPont R. L., McLellan A. T., White W. L., Merlo L., & Gold M. S. (2009). Setting the standard for recovery: 
Physicians Health Programs evaluation review. Journal for Substance Abuse Treatment, 36(2), 159-171. 

Ibid. [See: Domino, K. B., Hornbein, T. F., Polissar, N. L., Renner, G., Johnson, J., Alberti, S., & Hankes, L. (2005). 
Risk factors for relapse in health care professionals with substance use disorders. JAMA, 293, 1453-1460; 
Gastfried, D. R. (2005). Physician substance abuse and recovery: What does it mean for physicians—and everyone 
else? JAMA, 293, 1513-1515; Gold, M. S., & Aronson, M. D. (2004). Treatment of Alcohol Abuse and Dependence. 
Cambridge, MA: Harvard University UpToDate (CD ROM educational program); Smith, P. C., & Smith, J. D. (1991). 
Treatment outcomes of inpatient physicians in Oklahoma. Journal of Oklahoma State Medical Association, 84, 599- 
6-3; Talbott, G., & Wright, C. (1987). Chemical dependency in healthcare professionals. Occupational Medicine, 2, 
581-591.] 

: McLellan, A. T., Skipper, G. E., Campbell, M. G. & DuPont, R. L. (2008). Five-year outcomes in a cohort study of 
physicians treated for substance use disorders in the United States. British Medical Journal, 337:a2038. 

* DuPont, R. L. & Humphreys, K. (2011). A new paradigm for long-term recovery. Substance Abuse, 32(1), 1-6. 

*° DuPont R. L., McLellan A. T., White W. L., Merlo L., and Gold M. S. (2009). Setting the standard for recovery: 
Physicians Health Programs evaluation review. Journal for Substance Abuse Treatment, 36(2), 159-171. 


livelihood) and, as such, might be less resistant to behavior change; however, evidence from two 
criminal justice programs that have similar intensive monitoring procedures suggest that similar rates of 
long-term abstinence and improved quality of life can be achieved in criminal offender populations with 
substance use problems. 


Criminal justice programs. Participants in Hawaii’s Opportunity Probation with Enforcement (HOPE) 
have significant documented substance use problems and are at high risk for violating probation. In 
HOPE, offenders are subject to frequent random drug and alcohol testing for up to five years. A missed 
test or a positive drug test is met with an immediate short-term jail stay. Formal addiction treatment is 
available to offenders who request it and to those who demonstrate the need for treatment by 
repeated non-compliance and relapse to drug use. A randomized controlled evaluation found that after 
one year in the program, compared to offenders on standard probation, HOPE participants were 72 
percent less likely to use drugs and 55 percent less likely to be arrested for a new crime.” 


South Dakota’s 24/7 Sobriety Project is a similar program that specifically focuses on repeat driving 
under the influence (DUI) offenders. Participants are subject to twice-daily alcohol breath tests or to 
wearing continuous alcohol monitoring ankle bracelets, and subject to random drug urinalysis or 
wearing drug patches to detect the use of illegal drugs. Any positive test results in an immediate short- 
term jail stay. Formal addiction treatment is available but optional. Over the course of an average 120 
days in the program, 55 percent of participants never fail an alcohol test, 16.7 percent fail once, 12.5 
percent fail only twice and 16.9 percent fail three or more.*” DUI recidivism is substantially lower among 
24/7 Sobriety participants at one, two and three years following program completion and repeat 


offenses have dropped 12 percent at the county level.”? 


Drug Courts serve high-risk, high-need criminal offenders with diagnosed substance use disorders who 
are eligible for community supervision such as probation.” Participants are supervised by 
multidisciplinary teams that develop individualized treatment plans. Participants attend regular judicial 
status hearings and are subject to frequent random drug testing and gradually escalating sanctions, 
including short jail stays, for infractions of supervision such as drug use or missed appointments. 
Because Drug Court participants are mandated to participate in formal addiction treatment offenders 
are retained in addiction treatment longer than in other correctional programs. The impact of Drug 
Courts is impressive, significantly reducing re-arrest rates and promoting abstinence from alcohol and 


am Hawken, A., & Kleiman, M. (2009, December). Managing drug involved probationers with swift and certain 
sanctions: Evaluating Hawaii’s HOPE. National Institute of Justice, Office of Justice Programs, U.S. Department of 
Justice. Award number 2007-IJ-CX-0033. 

* South Dakota 24/7 Sobriety Program. Presented by Art Mabry, 24/7 Sobriety Program Coordinator. Available: 
http://apps.sd.gov/atg/dui247/247ppt.pdf (Retrieved July 8, 2014) 

ei Kilmer, B., Nicosia, N., Heaton, P., & Midgette, G. (2013). Efficacy of frequent monitoring with swift, certain, and 
modest sanctions for violations: insights from South Dakota's 24/7 Sobriety Project. American Journal of Public 
Health, 103(1), e37-e43. 

* National Association of Drug Court Professionals. (2013). Adult Drug Court Best Practice Standards: Volume I. 
Alexandria, VA: National Association of Drug Court Professionals. Available: 
http://www.nadcp.org/sites/default/files/nadcp/AdultDrugCourtBestPracticeStandards.pdf 


drug use. With cessation of drug use, there comes the potential for the improved quality of life in true 
recovery. 


Implications for five-year abstinence and recovery outcomes. The findings from the PHPs and 
from criminal justice system programs using similar long-term monitoring with consequences for any 
use of alcohol or other drugs are in stark contrast to typical outcomes for other programs. The latter 
programs show that a substantial percentage of participants (40-60 percent) relapse within six months 
of completing an episode of formal addiction treatment.’ The promising evidence from the New 
Paradigm programs provides a benchmark against which other programs can measure attainment of 
long-term abstinence and recovery as a realistic standard for treatment outcome. 


A hallmark of the New Paradigm of care management pioneered by the PHPs and other innovative 
programs is prolonged and intense monitoring through frequent random drug and alcohol testing to 
discourage and to identify substance use. A similar treatment parallel now occurs in medical practice. 
Recognizing that many chronic illnesses have significant behavioral elements and that compliance with 
good medical care is essential to manage chronic diseases, there is a new commitment to use of routine, 
sustained and long-term monitoring of patient behavior and compliance to improve outcomes. The 
commitment to patient-centered medical care with long-term monitoring and frequent assessment 
holds great promise for the management of substance use disorders. With such a model, health care 
clinicians could be encouraged to monitor patients with these disorders routinely regarding the status of 
their recovery. The successful management of substance use disorders includes conducting frequent 
random tests for the use of alcohol and other drugs as a routine monitoring of compliance, similar to the 
sustained monitoring for diabetes and hypertension. This model of integrated long-term monitoring 
and care management now being widely adopted throughout medicine holds the promise of 
incorporating many elements of the PHP model into routine health care for every patient suffering from 
a substance use disorder. In this context it is essential that health care clinicians not only recognize their 
important role in medically managing substance use disorders but that they also understand that long- 
term recovery is the objective. That means articulating this objective to patients and monitoring for its 
achievement. It also means that among health care there is must be a general recognition that the goal 
for patients with significant substance use disorders is complete abstinence from the use of alcohol and 
other drugs, and accompanying steps towards an improved quality of life. 


ss McLellan, A. T., Skipper, G. E., Campbell, M. G. & DuPont, R. L. (2008). Five-year outcomes in a cohort study of 
physicians treated for substance use disorders in the United States. British Medical Journal, 337:a2038. 

[See: Institute of Medicine (US) Committee on Crossing the Quality Chasm: Adaptation to Mental Health and 
Addictive Disorders. (2006). Improving the quality of health care for mental and substance-use conditions. 
Washington, DC: Institute of Medicine; Hubbard, R.L., Flynn, P.M., Craddock, G., & Fletcher, B. (2001). Relapse 
after drug treatment. New Haven, CT: Yale University Press; Project Match Research Group. (1997). Matching 
alcoholism treatments to client heterogeneity: project MATCH posttreatment drinking outcomes. Journal of 
Studies on Alcohol, 58(1), 7-29; Simpson, D. D., Joe, G. W., & Brown, B. S. (1997). Treatment retention and follow- 
up outcomes in the drug abuse treatment outcome study (DATOS). Psychology of Addictive Behaviors, 11(4), 294- 
301; Moos, R. H., Finney, J. W., & Cronkite, R. C. (1990). Alcoholism treatment: context, process and outcome. New 
York: Oxford Press.] 


Developing a New Framework for Long-Term Addiction Treatment 


Patient Outcomes 

The Appendix at the end of this document provides a broad overview of some of the current standards 
for determining the effectiveness of substance use disorder treatment interventions. These current 
standards mainly focus on substance-specific outcomes of patients while in treatment, and in the short- 
term following discharge. It is not useful to eliminate the current welter of methods to assess the 
efficacy of specific substance use disorder treatment interventions. Instead, there is an opportunity to 
raise the relevance of assessment standards by adding the long-term perspective with a focus on 
sustained recovery. 


As of 2014, with the implementation of the Affordable Care Act (ACA), services for substance use 
disorders must be included in all health insurance sold on Health Insurance Exchanges or provided by 
Medicaid. This will greatly increase access to addiction treatment for individuals who had previously 
been unable to afford these services. The Department of Health and Human Services (DHHS) is charged 
with the responsibility of identifying which evidence-based services will be insured. More specifically, 
DHHS “will take into account evidence on what services allow individuals to get the treatment they need 
and help them with recovery”.’® Ideally, patients would have access to those services that have the 


strongest evidence-base as well as the best long-term outcomes for sustained recovery. 


In addition to the impending increase in the number of individuals eligible for coverage of addiction 
treatment, in the current fiscal climate there is an intense focus on potential cost-saving strategies. 
With addiction treatment fewer instances of relapse and improved long-term outcomes in sustained 
recovery will lead to reductions in the costs associated with substance-related hospitalizations, impaired 
driving crashes, and incarceration. Research has shown that for every dollar spent on substance use 
disorder treatment, there is a return of $4-7 in reduced theft, drug-related crime, and criminal justice 
costs; with healthcare in this equation, the savings are a ratio of 12:1.” It is important that insurance 
providers support treatment and care monitoring that improves their members’ health, reduces their 
future health care costs and most notably, reduces readmission for treatment of substance use 
disorders. 


Cost-savings aside, when individuals with substance use disorders enter addiction treatment programs 
there is an expectation on the part of their families, employers, insurers and others that once patients 
complete the episode of care and are discharged, they will be securely on the road to long-term 
recovery. The new focus of treatment evaluation fits with this common expectation for the outcome of 
treatment even though it contrasts strikingly with the current performance of addiction treatment. 


*© Office of National Drug Control Policy. (n.d.). Substance abuse and the Affordable Care Act. Available: 
http://www.whitehouse.gov/ondcp/healthcare 

”” National Institute on Drug Abuse. (2012). Principles of Addiction Treatment: A Research-Based Guide a” 
edition). NIH Publication No. 12-4180. U.S. Department of Health and Human Services, National Institutes of 
Health, National Institute on Drug Abuse. Available: http://www.drugabuse.gov/publications/principles-drug- 
addiction-treatment 
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Presently, there is a lack of long-term outcomes data on patients who are discharged from addiction 
treatment programs. We challenge treatment programs and payers to measure the long-term 
outcomes of patients treated for substance use disorders following discharge, including abstinence. The 
data collected from these studies will significantly improve the outcomes of treatment programs and 
will help payers, patients, and patients’ families identify programs that best achieve abstinence that 
moves them towards sustained long-term recovery. 


This report describes strategies to measure long-term successful patient outcomes from addiction 
treatment. We explore three sources for outcome data collection: 1) addiction treatment programs, 2) 
outside evaluators including research organizations and consumer satisfaction organizations, and 3) 
addiction treatment payers, including insurance providers. There are many useful data elements that 
can be collected to determine long-term recovery outcomes. We focus on a few fundamental and 
practical ways to enhance and extend the present limited approach to evaluating treatment outcomes. 


Approach #1: Standard Treatment Patient Outcome Assessment 

The first approach to evaluating patient outcomes is for addiction treatment programs to follow-up with 
patients and/or their families for an extended period of time after discharge, for both patients that 
complete treatment and for patients who leave against medical/program advice. 


In preparation for this follow-up, at patient intake treatment programs should collect contact 
information for patients and designated family members to facilitate follow-up contacts. Patients and 
their families should understand at the outset of admission that the program will follow-up with them 
after the episode of treatment. Suggested follow-up outcome measurement intervals include one-year, 
three-years, and five-years post-discharge. The following sample data’ would be collected, ideally from 
patients directly, but possibly from family members, if appropriate. For this reason consent should be 
obtained from patients at intake for these data to be collected. 


» Following discharge from treatment was the patient monitored by the program for alcohol and 
other drug use (i.e. biological testing)? 
» Periods of abstinence (that are not substance-specific): through self-report, biological 
monitoring (if conducted) and treatment readmissions 
> Less than 30 days / 30-90 days / 3-6 months / 6-12 months /12-18 months, etc. 
» Periods of relapse: through self-report, biological monitoring (if conducted) and treatment 
readmissions 
>  Self-report alcohol use since discharge from treatment: None / Occasionally / Monthly / 
Weekly / Daily 
= If yes, indicate: with problems/ without problems 
> Number of heavy drinking days per month 
>  Self-report drug use since discharge from treatment: None / Occasionally / Monthly / 
Weekly / Daily 
= If yes, indicate: with problems/without problems 
= List of drugs used 


“The questions listed in this report are examples of useful data points to be collected. This report should not be 
used as a survey instrument but rather inform the development of survey instruments. 
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> Circumstances that led to relapse(s) 
> Changes in substances used and changes in frequency/quantity of use 
» Involvement in community-based recovery support (e.g. 12-steps): None / Occasionally / 
Monthly / Weekly / Daily 
» Recovery self-status evaluation: Do you consider yourself to be in recovery? Yes/No 
» Desire for recovery: Do you want to be in recovery? Yes/No 
» Employment/education status and recent history 
» Substance-related emergency department visits 
» Substance-related hospital admissions 
»  Substance-use related illness/disease 
» Substance-related accidents (e.g. workplace, motor vehicle crashes) 
»  Substance-related arrests/incarceration 
» Global functioning/quality of life 
» Psychological / subjective outcomes: cravings, mental health (anxiety/depression), overall 
health 
» Overall, how helpful was the treatment experience? 
>  1£xtremely unhelpful / 2 Moderately unhelpful / 3 Somewhat unhelpful / 4 Neither 
helpful or unhelpful / 5 Somewhat helpful / 6 Moderately helpful / 7 Extremely helpful 
» What elements of the treatment experience were most and least helpful? 
» What activities following treatment were most and least helpful in maintaining recovery? 


This is extensive list can be amended or shortened with the understanding that the focus needs to be on 
the extent to which the former patients are in sustained recovery, including being abstinent from 
alcohol and other drug use. It is unlikely that every addiction treatment program will be able to follow- 
up consistently with every patient over prolonged periods of time. Therefore, it is suggested that while 
every patient be contacted by programs as part of routine follow-up (e.g. 3 months), treatment 
programs conduct extensive follow-up with an admission cohort of patients through each follow-up 
interval at one-year, three-years and five-years post-discharge. 


There are practical concerns and considerations associated with treatment programs conducting these 
internal evaluations of patient program outcomes. For example, treatment programs may have 
incentive to alter their data for marketing purposes showing inflated rates of success. Similarly, patients 
may not accurately report their own outcomes or alternately, only those who are doing well may be 
inclined to provide information about their outcomes following discharge. Additionally, because this 
approach to measuring patient outcomes wholly relies on practitioners to collect data and input the 
information on a consistent basis, this could become onerous and resource-intensive and it may be 
necessary to create incentives or requirements for treatment programs to collect these outcome data. 


There are many differences between state and private treatment agencies and an absence of 
standardized reporting and central repositories may cause discrepancies between reporting. In all such 
programs, a modest level of oversight would ensure the integrity of data and findings. A potential 
solution to ease the data collection process for both state and private treatment programs, and to 
increase consistency across treatment programs, is the development of electronic options for 
assessments. Every addiction treatment program would use the same application and the data would 
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remain in a consistent format to be stored in a single location for that specific program. This would also 
permit aggregation and analysis of data from multiple treatment programs. 


An important concern is confidentiality and ensuring privacy of patient information. It is presumed that 
private treatment programs own their data but would have the option of sharing their data to be pooled 
with data collected by state treatment agencies. Important questions to be addressed include to which 
national agency would the state treatment outcomes be reported, who is responsible for analyzing the 
data, and how would the data be publicized? 


Thus, standard epidemiologically-driven questions that can be understood by every patient/family 
member need to be crafted to allow for analyses of the characteristics of persons who succeed and 
those who do not without information and selection bias. 


Approach #2: Independent Outcome Assessment Focused on Patient 


Satisfaction 

A second approach to evaluating treatment outcomes is to use a framework similar to customer 
satisfaction research. In this model, a research entity outside the treatment program would follow-up 
with a representative sample of patients after discharge to report short- and long-term outcomes. In 
this model patients (and when possible, their family members) report their level of satisfaction with the 
treatment process and determine whether the specific episode of treatment met their desired 
outcomes. It could also identify the extent to which patients achieved sustained recovery and used 
recovery support services after treatment discharge. This model could stand alone or be 
complementary to Approach #1 in providing an additional and confirming system to evaluate treatment 
outcomes. 


The independent research entity would contact all patients or an admission cohort following discharge 
from a treatment program. In anticipation of making these contacts, consent would need to be 
obtained at intake. 


Ideally, the same data items in the previous Approach #1 would be collected from patients and the 
families, following discharge from treatment. These data relate to, among other items, periods of 
abstinence, periods of relapse, involvement in community-based recovery support, self-report recovery 
status and desire for recovery. Like Approach #1, the suggested follow-up intervals to collect this data 
include one-year, three-years and five-years post-discharge. 


In addition to collecting the data items in Approach #1, in Approach #2, the independent research entity 
would collect data about the opinions of the treatment experience from both patients and their families. 
The following data would be collected from patients directly at one-year, three-years and five-years 
post-discharge: 


» Onascale from 1 to 7, how helpful was this episode of treatment? 
>  1£xtremely unhelpful / 2 Moderately unhelpful / 3 Somewhat unhelpful / 4 Neither 
helpful or unhelpful / 5 Somewhat helpful / 6 Moderately helpful / 7 Extremely helpful 
» For patients receiving medication-assisted treatment, while in treatment, were you compliant 
with medication (i.e. buprenorphine or methadone) for your opiate use disorder? 
> Not atall / Somewhat / Mostly / Completely 
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» On ascale from 1 to 7, how helpful was treatment for a co-morbid psychological and/or 
psychiatric condition? (0 Did not participate) 
» Were you compliant with medication and/or therapy for your co-morbid disorder? 
> Not atall / Somewhat / Mostly / Completely 
» Onascale from 1 to 7, how helpful was attending 12-Step meetings while in treatment? (0 Did 
not participate) 
» Onascale from 1 to 7, how helpful were group counseling sessions in treatment? (0 Did not 
participate) 
» Onascale from 1 to 7, how helpful were individual counseling sessions in treatment? (0 Did not 
participate) 
» Onasale from 1 to 7, how helpful were scheduled substance use screens in treatment? (0 Did 
not participate) 
» Onascale from 1 to 7, how helpful were random substance use screens in treatment? (0 Did not 
participate) 
» What was the approximate out-of-pocket cost to you personally? 
> Lost earnings? 
> Cost of treatment? 
> Other costs? 
» Do you consider the costs of this treatment episode money well spent? 
> Not atall / Somewhat / Mostly / Completely 
> Why or why not? 
» Did this treatment program meet your expectations? 
> Why or why not? 
» Would you recommend this treatment program to others with substance use disorders? 
> No/ Yes with reservations / Yes without reservations 
> Why or why not? 


In collecting patient outcome data using the self- and family-report model of Approach #1 and the 
customer satisfaction model of Approach #2, it must be understood that patients may be hostile to a 
treatment program due to the circumstances that led them to treatment admission and/or discharge in 
the first place. This approach could be particularly challenging for offender populations mandated to 
treatment, especially if relapse has the potential to result in sanctions. It would be important for the 
entity conducting this research (including the treatment program in Approach #1) to follow an admission 
cohort at the same interval for all patients and determine if the sample could be biased (e.g. only those 
who are doing well, or alternatively, those who had bad treatment experiences are likely to want to 
participate). 


The independent entity collecting these outcome data should follow up with family members to 
determine the veracity of patient claims and to ascertain family opinions in relation to the treatment 
experience and patient progress post-discharge. This additional information would be particularly 
useful as some patients may not be able to fully assess their progress or could be in denial about 
relapse. 


The following treatment program outcome measures could be collected by the independent entity 
through follow-up with designated family members of patients at the three intervals post-discharge: 
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» Onascale from 1 to 7, how helpful was this episode of treatment to the patient? 
>  1xtremely unhelpful / 2 Moderately unhelpful / 3 Somewhat unhelpful / 4 Neither 
helpful or unhelpful / 5 Somewhat helpful / 6 Moderately helpful / 7 Extremely helpful 
» For patients receiving medication-assisted treatment, while in treatment, was the patient 
compliant with medication (i.e. buprenorphine or methadone)? 
> Don’t know / Not at all / Somewhat / Mostly / Completely 
» Was the patient treated for a co-morbid psychological and/or psychiatric condition as part of 
the substance use disorder treatment? 
> Don’t know / Yes / No 
= If yes, ona scale of 1 to 7, how helpful was this treatment? 
> Was the patient compliant with medication and/or therapy for the co-morbid disorder? 
= Don’t know / Not at all / Somewhat / Mostly / Completely 
>» What was the approximate out-of-pocket cost to the patient (if known)? 
> Lost earnings? 
> Cost of treatment? 
> Other costs? 
» Do you consider the costs of this treatment episode money well spent? 
> Not atall / Somewhat / Mostly / Completely 
> Why or why not? 
» Did this treatment program meet your expectations? 
> Why or why not? 
» Would you recommend this treatment program to others with substance use disorders? 
> No/ Yes with reservations / Yes without reservations 
> Why or why not? 
Do you think the patient is in recovery? Yes / No 
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This broader data set collected by an independent entity would provide treatment programs with insight 
about how discharged patients perceive their treatment experiences as well as the perceptions of the 
value and impact of the treatment episode by family members. This information would inform addiction 
treatment programs to help them improve the quality of the services they provide to patients and their 
families. 


Approach #3: Recovery-Oriented System Model and Health Care Payers as 
Consumers 

In this approach, healthcare payers (i.e. insurance companies, Medicaid, Medicare) track their patients’ 
admissions to addiction treatment programs to identify the programs that yield the best outcomes, 
specifically measured by low re-admission rates. This approach is particularly useful in the current shift 
in health care delivery from fee-for-service to fee-for-performance. This form of evaluation encourages 
addiction treatment programs to focus on long-term care of patients. In this model, it is in the interest 
of all addiction treatment programs to ensure that re-admission rates after discharge, whether to their 
own programs or others following discharge, remain low. This approach will help payers identify 
programs that will result in costs-savings for the treatment of substance use disorders. 


In order to produce low readmission rates, addiction treatment programs could be influenced to orient 
their care toward long-term recovery. 
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Figures A and B depict a system of care for substance use disorders. They demonstrate the shift from 
the starting point of problem drug use (i.e. substance use disorder) through possible stages and then to 
the achievement of recovery. Patients enter the system of care — either voluntarily or by mandate — to 
an episode of treatment. In an idealized seamless transition from addiction to recovery, patients would 
enter a formal addiction treatment program and be discharged after the episode of treatment is 
complete (at the medical recommendation of the program). Leading up to and after discharge, the 
individual would be closely connected to recovery support services with the goal of preventing relapse 
to substance use. After an extended period of abstinence — and improved state of personal health and 
engaged citizenship — the individual would reach the condition of recovery which would be maintained 
for a lifetime. 


Figure A. 
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When relapse occurs, there is a need to immediately intervene with the individual, through recovery 
support services and possible readmission to treatment. Figures A and B show that is not just a 
treatment system supported by recovery support services, but the close interaction of episodes of 
treatment and relapse prevention services that create increasing periods of abstinence until recovery is 
ultimately achieved. 


For addiction treatment programs to be recognized by healthcare payers as high-achieving in terms of 
long-term patient outcomes, the following information would be collected and analyzed: 


» Average wait times for program admission 
» Attrition rate / rate of successful patient treatment completion (discharge not against 
medical/program advice) 
» Rate of patient readmission to treatment 
» Periods of patient abstinence determined through: 
> biological monitoring in treatment and following treatment 
> treatment readmissions 
» Periods of patient relapse determined through: 
> biological monitoring in treatment and following treatment 
> treatment readmissions 
» Use of recovery support services (e.g. linkage to 12-step programs) 
» Connection to/coordination with primary care clinicians prior to discharge 
» Follow-up with the patients, families and primary care physicians 
»  Substance-related emergency department visits 
» Substance-related hospital admissions 
»  Substance-use related illness/disease 
» Substance-related accidents (e.g. workplace, motor vehicle crashes) 
» Substance-related arrests / incarceration 


Like Approaches #1 and #2, there are limitations to Approach #3. One such limitation of Approach #3 is 
the risk of programs seeking to achieve “good” outcomes by limiting readmission in cases when 
treatment is needed. For this reason, in Approach #3, it would be useful to follow-up with a random 
sample of patients, independent from the insurance company, to ensure patients are getting the help 
they need and that the insurance companies are not simply avoiding readmission but that patients are 
abstinent and doing well. Denying readmission when treatment is needed is not a good outcome; when 
treatment is needed, it must be provided. 


Summary 

Each of the three approaches to evaluate addiction treatment outcomes is distinct in its purpose, but all 
assume the objective of the desired outcome is complete and long-term abstinence from nonmedical 
use of addictive substances. Approach #1 requires treatment programs to evaluate their patient 
outcomes based on self-report (and biological monitoring, if available) through follow-up with patients 
one-year, three-years and five-years post-discharge. 


Approach #2 builds on the data collected in Approach #1 by having an entity separate from the 
treatment programs follow up at one-year, three-years and five-years post-discharge with patients and 


17 


their families to capture their opinions about the quality and impact of the treatment provided. In each 
of these intervals, both patients and designated family members are contacted to determine specifically 
whether or not the treatment episode met their expectations. 


Finally, Approach #3 focuses on the healthcare industry as a consumer interested in identifying the 
treatment programs that produce the best long-term results, including specifically low rates of 
readmission, and thus, produce the greatest cost-savings. This approach, while practical, comes with it 
the potential for short-changing the path to final recovery in the name of cost savings. 


Over the course of the suggested follow-up intervals, some patients will be readmitted to the same or 
other addiction treatment programs. Likewise, the event that may have set an individual on the path to 
recovery may not be captured in these evaluations. There is no obvious way to ensure that treatment 
programs receive “credit” for helping individuals achieve recovery. It is most important now to develop 
new frameworks for addiction treatment programs to monitor long-term patient outcomes, for the 
benefit of patients and their families, to contain short- and long-terms costs, and to ensure that referral 
is to the programs that produce the best long-term outcomes. This report is written to define the 
ultimate goal of treatment as well as to encourage this development of effective strategies to assess 
long-term outcomes of treatment. 


Conclusions and General Recommendations for Improving Long-Term 


Patient Outcomes 

This report advocates for the creation of five-years of abstinence on a path to full recovery as the 
standard outcome measure of the treatment of individuals with substance use disorders. Although 
substance use disorders are serious chronic illnesses that require long-term care, the vast majority of 
addiction treatment programs provide only brief episodes of care. Use of the five-year standard 
requires the identification of what happens to patients after they are discharged from treatment. 


The question of how patients with substance use disorders can best reach the desired outcome of five- 
year abstinence and full recovery is, for now, largely answered by the evidence provided by the systems 
of care management termed the New Paradigm for Recovery. These programs demonstrate that long- 
term abstinence and achieving a higher quality of life can be the outcome for a majority of patients 
regardless of the drugs they have used. In fact, recovery can be the expected outcome of treating and 
managing substance use disorders. Such programs require long-term active care management to extend 
and support relatively brief episodes of addiction treatment. This long-term monitoring of substance 
use disorders fits into the standard medical model of the care of many chronic diseases and can be 
managed in a variety of settings including primary care. 


Achieving the proposed outcome of five-year abstinence and recovery requires long-term engagement 
of patients. This includes linking patients and their families prior to and following treatment discharge 
to primary care physicians for long-term care. It also includes long-term monitoring of substance use 
with random drug and alcohol tests either by the primary care physicians and/or by external monitoring 
services. Higher rates of achieving sustained recovery mean lower health care costs and improved 
health. 
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The three approaches to outcomes measurement proposed in this report suggest methods of 
documenting the long-term outcomes of patients treated for substance use disorders and have the 
potential to be implemented widely. Documenting the long-term outcomes of individuals with 
substance use disorders discharged from addiction treatment programs should lead to improved care 
and better delivery of services. Moreover, monitoring the long-term outcomes of patients should assist 
payers (and families) to assess which programs result in the best outcomes and the most cost-savings. 


Making five-year abstinence and recovery a standard outcome measure of treatment evaluation and 
making these evaluations public could challenge treatment programs and clinicians to focus their efforts 
to achieve better long-term patient outcomes. Hopefully coupled with innovations in treatment, the 
demonstrated results of patient monitoring and management following addiction treatment will bring 
significant improvement in the nation’s public health. 
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Appendix: Current Substance Use Disorder Treatment Efficacy Standards 
There are many varying models of addiction treatment. Some treatment models treat all types (and co- 
occurring) substance use disorders, while others prioritize the treatment of specific substance use 
disorders. Additionally, some forms of addiction treatment include the use of medication (e.g. 
buprenorphine, methadone). 


Before reviewing the current treatment efficacy measures for treating addiction and specific substance 
use disorders, we first review terminology and how practices are evaluated as ‘evidence-based.’ 


A. Defining ‘Efficacy’ and Evidence-Based Treatment Practices (EBPs) 

The term evidence-based treatment refers to interventions, practices, and techniques that have proven 
to have positive or preferred outcomes through consistent scientific study.* » Because these 
interventions are validated by research to ‘work’ their wide implementation is encouraged. Efficacy and 
effectiveness are terms often used interchangeably; however, in the context of treatment outcomes, 
they have slightly different meanings. Treatment efficacy is the “clinical benefit produced by the 
intervention in the context of controlled research”, whereas effectiveness refers to the “clinical benefit 
produced in a clinical setting under naturalistic conditions” (p.95).° 


The classification of interventions as evidence-based or effective requires high quality research designs. 
Randomized controlled trials (RCTs) or rigorous quasi-experimental designs are most commonly used for 
the purpose of demonstrating efficacy." The accepted standard is a minimum of two rigorous studies 
with similar findings on key outcomes that demonstrated positive outcomes (see the Food and Drug 
Administration Model). 


To critically evaluate a substance use disorder treatment study, the design is not the only element to 
consider. Different levels of evidentiary strength create a hierarchy by which researchers can draw 
conclusions about research findings.° These standards are as follows: 


» Gold standard — multiple replications of RCTs in different sites. There must be significant and 
sustained reductions in risk behaviors and controls for sample attrition. A preponderance of 
evidence supporting effectiveness across multiple sites is needed to meet this evidentiary 
standard. Research designs that adhere to the gold standard have high internal and external 
validity. 


* Glasner-Edwards, S., & Rawson, R. A. (2010). Evidence-based practices in addiction treatment: review and 
recommendations for public policy. Health Policy, 97(2-3), 93-104. 

Taxman, F. S., & Belenko, S. (2012). Implementing Evidence-Based Practices in Community Corrections and 
Addiction Treatment. Springer Series on Evidence-Based Crime Policy. Springer Science+Business Media, LLC. 
“ Glasner-Edwards, S., & Rawson, R. A. (2010). Evidence-based practices in addiction treatment: review and 
recommendations for public policy. Health Policy, 97(2-3), 93-104. 

7 Taxman, F. S., & Belenko, S. (2012). Implementing Evidence-Based Practices in Community Corrections and 
Addiction Treatment. Springer Series on Evidence-Based Crime Policy. Springer Science+Business Media, LLC. 
* Taxman, F. S., & Belenko, S. (2012). Implementing Evidence-Based Practices in Community Corrections and 
Addiction Treatment. Springer Series on Evidence-Based Crime Policy. Springer Science+Business Media, LLC. 
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» Silver standard — quasi-experimental design with strong statistical controls but includes the 
same outcome and replication requirements as the more stringent gold standard. 


» Bronze standard — matched comparison groups without adequate statistical controls. 


To determine whether an intervention is effective over time, it is recommended that a longitudinal 
design be employed in which data is collected at multiple intervals. In the context of the current 
discussion, extended longitudinal study is needed to assess long-term outcomes of specific interventions 
and treatments. 


The implementation of an intervention is an additional consideration as factors related to delivery and 
practice can potentially influence treatment outcomes. For example, fidelity to the treatment model, 
practitioner buy-in and training, delivery setting, and can alter the way in which a patient experiences an 
intervention which could, subsequently, yield different effects —positive or negative.’ 


B. Current EBP Classification Models and Approaches 

A multitude of models and approaches are currently utilized by government agencies and the addiction 
field to determine whether treatment interventions are effective. Some models demand high levels of 
scientific rigor through RCTs whereas others rely upon synthesis of evidence and practitioner consensus 
as the basis for evidence-based designations. Table 1 at the end of the Appendix provides an overview 
of several such models. 


Regardless of the approach taken, the longer the study, the more information can be gathered about 
the effectiveness of the intervention. Longitudinal studies can identify optimal dosages, individual 
effective components of interventions, and the effectiveness of the intervention among different 
populations. It is this type of long-term follow-up (e.g., Phase IV in the NIH Guidelines) that elicits 
valuable information from a practice and performance measurement perspective as it sheds light on 
what is working well over time. 


C. Current Addiction Treatment Efficacy Measures 
The following is a review of current efficacy measures used in clinical trials leading to labeled and off- 
label use for addiction treatment. 


Behavioral Therapy 
Many studies include a psychotherapy component, commonly as an adjuvant to pharmacotherapy.® 
Specific methodologies include: 

» Motivational enhancement therapy 

» Cognitive behavioral therapy 


» Contingency management 
‘ Glasner-Edwards, S., & Rawson, R. A. (2010). Evidence-based practices in addiction treatment: review and 
recommendations for public policy. Health Policy, 97(2-3), 93-104. 


® Danovitch, |., & Gorelick, D. A. (2012). State of the art treatments for cannabis dependence. The Psychiatric Clinics 
of North America, 35(2), (2):309-26. 
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» Supportive-Expressive Psychotherapy 


» Community and family interventions 


Pharmacological Therapy 

While short-term therapeutic endpoints may be adequate for some targets of addiction treatment, such 
as overdose and withdrawal, treatment for prevention of relapse and craving management require 
endpoints that focus on long-term efficacy. Although one may consider these as separate modalities of 
addiction therapy, it would be inappropriate to say that one approach can be used to obtain successful 
long-term outcomes, particularly since one cannot begin to consider prevention of relapse without 
initial adequate detoxification. In addition, treatment of substance dependence to prevent relapse may 
also serve to manage or prevent withdrawal symptoms; such as with nicotine replacement therapy and 
opioids for opioid maintenance, among others. 


While specific pharmaceuticals used in treatment of underlying addiction vary by substance, efficacy 
endpoints utilized in clinical trials often focus on relapse prevention, psychological and subjective 
progress, or social recovery. 


Relapse prevention is the primary goal of addiction treatment, allowing for full rehabilitation of patients 
to lives without substance dependence. Reason would imply that relapse prevention would exclusively 


refer to abstinence from the substance of use for the full course of a study, but in reality, some clinical 


h 2-6 


trials focus on short-term abstinence of one to three weeks. In defense of this method, some studies 


have suggested that continuous cocaine and alcohol abstinence of three weeks is predictive of long- 
term cocaine abstinence.’ ' More lenient endpoints may not always be justified, but may be used due to 
a shorter study duration, high attrition! ®, or perhaps high variability of time to response among 
patients. Study durations range from 1 week to 2 years, varying widely between treatments of various 
substances. For example, studies of alcohol dependence range from 4 weeks to 2 years «9 while 
duration of studies for treating cocaine dependence have a much shorter range of 5 to 25 weeks. Many 
studies only recorded outcomes for a mere 12 weeks. Although study duration varies, even in the case 


A Castells, X., Casas, M., Pérez-Majfia, C., Roncero, C., Vidal, X., Capella, D. (2010). Efficacy of psychostimulant drugs 
for cocaine dependence. The Cochrane Database of Systematic Reviews, (2), CD007380; Pani, P. P., Trogu, E., 
Vacca, R., Amato, L., Vecchi, S., & Davoli, M. (2010). Disulfiram for the treatment of cocaine dependence. The 
Cochrane Database of Systematic Reviews, (1), CD007024; Pani, P. P., Trogu, E., Vecchi, S., Amato, L. (2011). 
Antidepressants for cocaine dependence and problematic cocaine use. The Cochrane Database of Systematic 
Reviews, (12), CD002950; Nunes, E. V., McGrath, P. J., Quitkin, F. M., Ocepek-Welikson, K., Stewart, J.W., Koenig, 
T., Wager, S., & Klein, D.F. (1995). Imipramine treatment of cocaine abuse: possible boundaries of efficacy. Drug 
and Alcoho! Dependence, 39(3), 185-95; Weinstein, A. M., & Gorelick, D. A. (2011). Pharmacological treatment of 
cannabis dependence. Current Pharmaceutical Design, 17(14), 1351-1358. Available at: 
http://www.ncbi.nim.nih.gov/pmc/articles/PMC3171994/ (Accessed March 14, 2014.) 

‘Skinner, M. D., Lahmek, P., Pham, H., & Aubin, H-J. (2014). Disulfiram efficacy in the treatment of alcohol 
dependence: a meta-analysis. PLoS One, 9(2), e87366. 

: Cahill, K., Stead, L. F., & Lancaster, T. (2012). Nicotine receptor partial agonists for smoking cessation. The 
Cochrane Database of Systematic Reviews, (4), CD006103. 

Rosner, S., Hackl-Herrwerth, A., Leucht, S., Vecchi, S., Srisurapanont, M., & Soyka, M. (2010). Opioid antagonists 
for alcohol dependence. The Cochrane Database of Systematic Reviews, (12), CD001867. 
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of substantial duration of a year or more, primary endpoints for efficacy may be assessed at much 
sooner time points, rather than the full length of the study.’ Another point of interest is that many 
studies choose retention in treatment as a surrogate for relapse prevention. Although retention in 
adequate treatment programs is vital to success of a recovering addict, it does not confer that a 
treatment is efficacious or that a subject does not relapse to some extent. Lastly, a quantification of 
substance use may be used to demonstrate a change in overall use. While this has the ability to 
demonstrate treatment efficacy, one cannot use these endpoints to assess whether a patient can attain 
complete abstinence from a substance with a particular treatment. 


Psychological evaluations and subjective progress can be used to characterize a patient’s recovery, their 
addiction severity (i.e. Addiction Severity Index, Clinical Global Impression score for dependence), 
cravings (i.e. Visual Analog Scale, Craving Analogue Scale, Voris Cocaine Craving Questionnaire, 
Obsessive Compulsive Drinking Scale), and/or withdrawal symptoms. Often, additional assessments for 
depression or anxiety are also included and evaluated. Finally, some studies also examine aspects of 
social recovery, such as avoidance of criminal activity or re-incarceration, and consistent employment. 
These endpoints might be considered somewhat secondary to preventing further substance use, but are 
significant when assessing the effects of treatment on all aspects of recovery. 


Table 2 at the end of the Appendix examines these endpoint categories in the context of various 
treatments for each substance-specific substance use disorder. The agents listed have been studied for 
their efficacy. Inclusion in this table does not imply that their efficacy has been established. 


D. Limitations of Current Efficacy Standards /Models 

Current research of treatment interventions suffer from a variety of methodological weaknesses. These 
include poor research design, unclear or varying definitions of research concepts, low internal and/or 
external validity, small sample sizes, and insufficient statistical calculations. The way in which the 
success or efficacy of treatment is measured also varies widely across studies. 


Critical analysis of current substance use disorder treatment evidence standards revealed four major 
limitations: 


1. Follow-up intervals. Findings of treatment intervention efficacy in the absence of any follow-up 
post-discharge or exit, fails to make a case for any long-term effects. Most interventions are 
relatively short in duration and while there may be positive effects in substance use during 
treatment, there is no way to determine whether those effects are sustained post-treatment. In 
order to determine whether there is lasting change in substance use behavior, follow-up is 
necessary. Moreover, a single follow-up interval within a few months of treatment cessation is not 
enough to establish a finding of prolonged recovery. To determine the duration or decay of effects, 
and to identify the conditions under which long-term sobriety may be achieved, a longitudinal or 
cohort study design spanning several years should be selected. This means the funding agencies 


Cahill, K., Stead, L. F., & Lancaster, T. (2012). Nicotine receptor partial agonists for smoking cessation. The 
Cochrane Database of Systematic Reviews, 4(4), CD006103. 
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must be willing to “pay it forward” and allow some grants to be extended years, rather than limiting 
them to just five years. The research team may not be able to discover how successful the treatment 
was if they are only allowed to follow the participants for one or two years. Reviewers need to 
understand the importance of longitudinal research. Too often major studies have been shut down 
when reviewers write on the summary statements that the study lacked innovation, that no new 
information would come from a longitudinal study, or that not enough publications had been 
written yet, when the final endpoint had not even been reached. Moreover, grant reviewers could 
benefit from training on the importance of these study designs. 


2. Outcome measure definitions. The absence of standardization or uniform definitions for outcome 
measures can make comparisons among interventions challenging. For instance, measures such as 
sobriety, relapse, recovery, and alcohol and other drug use can each be defined very differently 
according to individual agencies or study methods. A similar problem exists in the criminal justice 
system with the outcome measure of recidivism. The lack of a uniform definition limits the ability to 
make accurate comparisons from one agency to another let alone from one jurisdiction to another. 
Moving forward, the development of standard, agreed-upon treatment outcome measures with 
universal definitions could be useful. 


3. Evidence threshold. There is a lack of agreement among experts on a specific minimum threshold 
of evidence or cut-off point below which evidence should be considered insufficient for a finding of 
effectiveness.” Similarly, there is debate as to whether a small amount of evidence constitutes no 
evidence. There is great disparity in outcome effects for alcohol and other drug interventions. As the 
analysis demonstrated, some ‘evidence-based’ interventions have small or incremental positive 
results that are present only during the course of the intervention whereas other interventions have 
pronounced positive results that are sustained over time a much longer timeframe. Yet both may be 
deemed evidence-based. 

4. Treatment success. The limitation of current substance use disorder treatment evidence is the lack 
of consensus regarding successful outcomes. It is this lack of consensus that motivates the 
development of the new standard proposed in this report. What treatment outcomes are deemed a 
success? Long-term recovery, decrease in alcohol and other drug use, or a certain amount of time 
between discharge and relapse? The answers to these questions are largely dependent on what 
standard the field wants to hold itself to and whether the perception of treatment success is long- 
term sobriety or if relapse is considered to be inevitable in most cases. 


™ Center for Substance Abuse Prevention. (2009). Identifying and Selecting Evidence-Based Interventions: Revised 
Guidance Document for the Strategic Prevention Framework State Incentive Grant Program. HHS Pub. No. 
(SMA)09-4205. Rockville, MD: Center for Substance Abuse Prevention, Substance Abuse and Mental Health 
Services Administration. 
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Tables 


Table 1 was developed by Erin Holmes, MA. Table 2 was developed by Amelia N. Deitchman, PharmD (PhD Candidate). 


Table 1. Substance Use Disorder Treatment Models and Requirements to Determine Effectiveness 





Model 


Purpose and approach 


Requirements 





Food and Drug 
Administration (FDA) 
Guidelines 


The FDA is responsible for the review of 
scientific evidence to determine whether 
pharmaceutical treatments are safe for 
public consumption. 

In order for a medication to be approved 
by the FDA, there must be a substantial 
body of evidence that demonstrates that 
the drug is both safe and effective. 


Rigorous standards 

Multiple, replicated RCTs 

High methodological quality of evidence 

Findings of a positive treatment effect relevant to target groups 
Findings replicated in a minimum of two different studies 
Overall consistency of evidence in the direction of effect 
Significant scientific agreement (Taxman and Belenko, 2011) 





National Institutes of 
Health (NIH) Guidelines 


The NIH guidelines translate and expand 
the FDA model applying it to behavioral 
health interventions. This model consists 
of four different phases of clinical trials to 
evaluate the effectiveness of treatment 
interventions. 


Phase | trials involve a small test group of 20 to 80 subjects. It is at this 
stage that early indications and evidence of efficacy emerge. These initial 
trials also identify potential side effects, determine dosages, and evaluate 
the safety of the intervention (NIH, 2013). 

Phase Il trials are larger and involve 100 to 300 subjects. The focus of this 
phase is to determine the efficacy of the treatment within a controlled 
setting and a focused target population. 

Phase Ill trials are conducted in multiple locations and settings where the 
researchers have less control over a larger number of subjects (1,000- 
3,000). The multisite nature and extended length of these trials allows 
researchers to collect longitudinal data and determine effectiveness over 
time, monitor potential side effects, and make comparisons to other 
interventions (NIH, 2013). 

Phase IV involves the continued collection of data after the interventions 
has been marketed. 








Center for Substance 
Abuse Prevention 
(CSAP) Guidelines 





The CSAP guidelines are used to classify 
treatment interventions as evidence- 
based. 





Interventions must meet one or more of the following to be considered 
evidence-based: 
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The approach utilized by CSAP is 
advantageous in that there are multiple 
criteria to determine whether evidence 
exists to establish effectiveness. 


inclusion in Federal registries of evidence-based interventions (such as 
the National Registry of Evidence-Based Programs and Practices (NREPP)); 
reported in peer-reviewed journals with positive effects on the primary 
targeted outcome; and, 

documented evidence of effectiveness based on guidelines developed by 
the Substance Abuse and Mental Health Services Administration 
(SAMHSA) and the Center for Substance Abuse Prevention (CSAP, 2009). 
These guidelines require that the intervention be: based on a theory of 
change that is documented in a conceptual model; similar in content and 
structure to other interventions that are found in Federal registries or 
academic literature. 

There should be documentation of instances of past implementation 
where there was attention to scientific standards of evidence with results 
that show a pattern of positive effects. 

The intervention should be “reviewed and deemed appropriate” by a 
panel of experts comprised of prevention researchers and practitioners 
(CSAP, 2009). 








National Institute on 
Drug Abuse (NIDA) 
Principles 





NIDA uses a consensus approach in 
formulating its Principles of Drug Addiction 
Treatment (Taxman and Belenko, 2011). 
The majority of the Principles are, in fact, 
considered to be best practices in the field 
as opposed to empirically validated EBPs. 
The use of a consensus approach can 
complement rigorous scientific study. The 
experiences of practitioners should not be 
undervalued as they have insight into the 
barriers and challenges associated with 
the translation of treatment research into 
practice in a real-world setting. 





Qualitative methods such as focus groups and key informant interviews 
are used to obtain the professional opinion of practitioners about which 
practices and interventions they deem effective. 
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Table 2. Endpoints in the Treatment of Substance Use Disorders, by Substance 





Drug 


Study 
Duration 


Study Agents 


Endpoints 





Relapse Prevention 


Psychological and 
subjective progress 


Social Recovery 





Nicotine® 


24 to 52 
weeks 


a ae. 10-29 
varenicline : 


bupropion sustained 
13,14,17 

release , and 

nicotine 


10,11,27 
replacement 


Dropouts or treatment retention 


Abstinence 

e 7-day point-prevalence abstinence 

e Carbon monoxide-confirmed 
continuous abstinence at 9, 12, 24, 
and 52 weeks 

e Self-reported at 4 weeks, 6 months, 
and 2 years 

e Smoking less than 5 cigarettes during 
the previous 6 months, and none in 
the week prior to visit 


Cigarettes per day 50% or more reduction 


Timing and number of quit attempts 


Cravings 





Alcohol 





Disulfiram 


7,30-36 


8 to 52 
weeks 








Abstinence 
e Time to first heavy drinking day 
e Number of abstinent days 
e Consecutive abstinence for 3 or 4 
weeks 
e Continuous 


Relapse 

















Notes: In one study, the consumption of five or more drinks for men and four or more drinks for women was termed a “heavy drinking 
day”, while other studies used this definition to describe the “relapse” endpoint. Although other studies defined “relapse” slightly 
differently, as the consumption of more than five drinks in 24 hours (i.e. 40 g of alcohol). 
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Drug Study Study Agents Relapse Prevention Psychological and subjective | Social Recovery 
Duration progress 
Opioid antagonists” 4 to 54 naltrexone’ Time to relapse, heavy drinking Cravings 
weeks nalmefene’”’ ** e Variations in definitions range from > 
(mode 12 4 SDU to 2 9 SDU, with different cut- 
weeks) offs for men versus women in most 
cases. Most common: 2 5 SDU for 
men or 4 for women 
e Drinking = 5 days per week 
Degree of drinking 
e Light, moderate, risky drinking with 
varying definitions 
e Drinks per drinking day 
e “Good clinical outcome” based on 
amount of drinking 
Abstinence 
e Number of days 
e Cumulative abstinence 
Acamprosate’” 8 weeks Time to relapse, heavy drinking: similar Craving (Clinical Global 
to 24 variations as described above Impression Scale) 
months e Relapse duration 











e Relapse severity 


Degree of drinking 
e Percent heavy drinking days 
e Drinks per drinking day 
e “Good clinical outcome” 


Abstinence 

e Days abstinent 

e Continuous abstinence 

e Between visit abstinence 
Time to first drink 
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e Illicit drug use: urine drug screen and 
self-report for heroin, amphetamines, 
cocaine, barbiturates and alcohol; 
Frequency ranged from monthly to 
daily collection 

e Program retention, compliance, 
continued treatment post-study 


Risk behavior 
e HIV, HCV seroprevalence 
e Syringe sharing 








Drug Study Study Agents Relapse Prevention Psychological and subjective | Social Recovery 
Duration progress 
Anticonvulsants 4to 52 topiramate, Time to relapse, heavy drinking: similar Cravings (OCDS and 
weeks gabapentin", variations as described above Craving Analogue Scale) 
valproate 7°71”, e Heavy drinking with or without 
levetiracetam’**”?, problems 
carbamazepine” ”, e Dropouts 
tiagabine e Minor, major, severe relapse 
Degree of drinking 
e Moderate drinking 
e Sustained heavy drinking days: 3 
consecutive heavy drinking days 
e Duration of heavy drinking 
e Drinks per drinking day, week 
Abstinence 
e Days abstinent 
e Complete abstinence 
e Continuous abstinence 
Opiates 
Methadone 1 month Relapse Health Employment 
to 2 years e Heroin use: hair analysis and self- 
report Mortality Education 


Reincarceration 
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Drug Study Study Agents Relapse Prevention Psychological and subjective | Social Recovery 
Duration progress 
Naltrexone’ 1to12 Relapse Cravings Reincarceration 
months e Retention in treatment 
(avg 6 e Retention without relapse 
months) e Days to drug use: urine drug screen 
Abstinence 
e Monthly abstinence 
e Complete abstinence 
Buprenorphine +/- 2 to 52 Relapse Cravings Incarceration, 
naloxone”? weeks e Retention in treatment, compliance criminal 
se ee (attendance) Opioid withdrawal ratings behavior 
e Drug use: self-report and urine drug 
screen for opioids, cocaine, Dependence severity rating 
amphetamines, cannabis, and by patient 
benzodiazepines, breath alcohol 
Psychosocial adjustment and 
Treatment dosage psychopathology 
e % taking original dose 
e % requesting dose change 
e Dose adequacy 
Continuous Abstinence 
Psychosocial 6 to 48 Relapse Severity of dependence as Employment 
Combined with weeks e Retention in treatment addiction severity index (ASI) 


Maintenance 
204-215 
Therapy 














e Compliance to counseling; adherence 
Degree of use by urine drug screen 


Abstinence 
e 3 consecutive weeks 





and risk assessment battery 


Average maintenance 
treatment dose 


Psychiatric 
symptoms/psychological 
distress 

e Internal-External Locus 

of Control 

e Interpersonal Trust 

e State-Trait Anxiety 

e Social Desirability 





Academic 
involvement 


Criminal activity 
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Drug Study Study Agents Relapse Prevention Psychological and subjective | Social Recovery 
Duration progress 
e Depression 
e Assertion 
e Pleasant Events 
e Beck Depression 
Inventory with 
Symptom Check List-90 
Cravings 
Cocaine/Stimulants 
Psychostimulants” 6 to 24 modafinil”’’, Relapse Cravings (VAS, brief 
weeks selegiline’”, e Retention in treatment substance craving scale 
methylphenidate IR and e Self-reported use 1-3 times weekly (BSCS), cocaine craving 
Rue 220. urine drug screen questionnaire (CCQ), or 
dextroamphetamine IR Tiffany Cocaine Craving 
and SR”, mazindol Continuous abstinence for 2 or 3 weeks Scale) 
IR**>??8 bupropion IR 
and SR22? 232 
Disulfiram?? 7” 11 to 12 Relapse Cravings (VAS) 
weeks e Retention in treatment 
e Abstinence duration with and without | Addiction severity index 
alcohol 
Degree of use 
e Frequency and intensity of use: days 
per week, grams per week 
e Urine drug screen 3 times per week 
e Dollar value of daily cocaine use 
Abstinence: days to continuous 
abstinence for 3 weeks 
Anticovulsants~ 1to 24 lamotrigine’, Relapse: Study dropout Cravings 
weeks gabapentin’ ~", 
carbamazepine’ ~"”, Degree of use 
phenytoin?*7”?, e Self-reported 
tiagabine 90? e Thrice weekly urine drug screen 








‘ 252 
topiramate 





Weekly abstinence 
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Drug Study Study Agents Relapse Prevention Psychological and subjective | Social Recovery 
Duration progress 
Antidepressants’ 2 to 25 imipramine, Relapse Cravings (cocaine craving 
weeks desipramine’’°**??°?**”, |» Retention to treatment scale, VAS) 
fluoxetine”, e Attendance to psychological program 
nefazodone’”**”" e Overall abstinence Addiction severity index 
paroxetine’, 
venlafaxine””, Severity of use 
ritanserin’”°?””, Self-reported use 
selegiline™ ”, e 13-items Quantitative Cocaine 
pSPUOnE , Inventory (QCl) 
sepirone i e Urine drug screen 
HYBLOPNA 7. * Cocaine use inventory 
Heats Lee f e Weekly frequency, amount, route of 
citalopram ; nee 
sertraline 
Abstinence 
e Longest period of continuous 
abstinence 
e Continuous abstinence for 3 weeks 
Dopamine agonists’ 1.5 to 16 carbidopa/levodopa~ Relapse: Cravings 
weeks oS e Retention to treatment, attendance 
amantadine" "en" e Study dropouts 
, pramipexole e Abstinence 
Degree of use by urine drug screen 
Antipsychotics” 5-168 haloperidol”, Relapse: Retention in treatment Cravings: VAS, Voris Cocaine 
days risperidone”, Craving Questionnaire 
olanzapine *”” Degree of use by urine drug screen 
Severity of dependence: 
Clinical Global Impression 
Scale (CGIS), Addiction 
Severity Index (ASI) 
Cannabis” 11-13 dronabinol””, Relapse Craving (Marijuana Craving 
weeks lofexidine, divalproex”, e Treatment retention Questionnaire) 








302 
nefazodone ~, 


bupropion ae lithium 
[for withdrawal]*”’, 


entacapone. 





e Time to dropout 


Degree of use 
e Self-reported use — strong 





Severity of dependence: CGIS 
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Drug 


Study Study Agents Relapse Prevention Psychological and subjective | Social Recovery 
Duration progress 








P 304,305 . 300 
atomoxetine , correspondence to urine drug screen 


buspirone”, fluoxetine e Days of use per week 

e Hits per day?” 

e Urine drug screens (except when 
treated with dronabinol) for 
cannabinoids, opiates, methadone, 
barbiturates, amphetamine and 
cocaine 

e Dollar amount spent on cannabis since 
last visit 


Abstinence 
e Number consecutive days of 
abstinence 
e Abstinence during the final 2 weeks of 
treatment 
e 3 consecutive weeks of abstinence 























Notes: Interestingly, one study’ followed a group of ten adolescents treated with 12 weeks of fluoxetine for major depression with 
comorbid alcohol and cannabis abuse. After one, three, and five years, dependence was determined based on DSM-IV criteria. This is 
the only study found with such extensive follow-up that used diagnostic criteria to evaluate absence of dependence. 
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